BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Binding events by Ev. Decom. - Approx. Span & Recur. matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[JULIELab ] Binding 398 ( 253) 461 ( 253) 63.57 54.88 58.91
[ UTurku ] Binding 398 ( 212) 328 ( 212) 53.27 64.63 58.40
[ UTokyo ] Binding 398 ( 187) 304 ( 187) 46.98 61.51 53.28
[UT+DBCLS ] Binding 398 ( 158) 237 ( 158) 39.70 66.67 49.76
[VIBGhent ] Binding 398 ( 179) 327 ( 179) 44.97 54.74 49.38
[ UZurich ] Binding 398 ( 145) 250 ( 145) 36.43 58.00 44.75
[ConcordU ] Binding 398 ( 134) 229 ( 134) 33.67 58.52 42.74
[ UNSW ] Binding 398 ( 132) 220 ( 132) 33.17 60.00 42.72
[ SCAI ] Binding 398 ( 148) 312 ( 148) 37.19 47.44 41.69
[CNBMadrid] Binding 398 ( 238) 753 ( 238) 59.80 31.61 41.36
[ NICTA ] Binding 398 ( 147) 314 ( 147) 36.93 46.82 41.29
[ Team 24 ] Binding 398 ( 116) 194 ( 116) 29.15 59.79 39.19
[ UMich ] Binding 398 ( 280) 1309 ( 280) 70.35 21.39 32.81
[ASU+HU+BU] Binding 398 ( 90) 155 ( 90) 22.61 58.06 32.55
[ UNIMAN ] Binding 398 ( 80) 109 ( 80) 20.10 73.39 31.56
[UAntwerp ] Binding 398 ( 88) 163 ( 88) 22.11 53.99 31.37
[ KoreaU ] Binding 398 ( 76) 101 ( 76) 19.10 75.25 30.46
[CIPS-ASU ] Binding 398 ( 91) 206 ( 91) 22.86 44.17 30.13
[ USzeged ] Binding 398 ( 90) 206 ( 90) 22.61 43.69 29.80
[ UAveiro ] Binding 398 ( 78) 149 ( 78) 19.60 52.35 28.52
[ Cam ] Binding 398 ( 75) 138 ( 75) 18.84 54.35 27.99
[CCP-BTMG ] Binding 398 ( 70) 111 ( 70) 17.59 63.06 27.50
[ Team 09 ] Binding 398 ( 63) 162 ( 63) 15.83 38.89 22.50
[ PIKB ] Binding 398 ( 50) 77 ( 50) 12.56 64.94 21.05
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Binding 419 ( 159) 239 ( 159) 37.95 66.53 48.33
[ Team 24 ] Binding 419 ( 117) 199 ( 117) 27.92 58.79 37.86
[CNBMadrid] Binding 419 ( 244) 1013 ( 244) 58.23 24.09 34.08
[ASU+HU+BU] Binding 419 ( 90) 155 ( 90) 21.48 58.06 31.36
[UAntwerp ] Binding 419 ( 89) 167 ( 89) 21.24 53.29 30.38
[CCP-BTMG ] Binding 419 ( 70) 111 ( 70) 16.71 63.06 26.42
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------